Electronic handheld audio/video receiver and listening/viewing device

ABSTRACT

A handheld device in an audio and video system including a system for receiving and processing video and/or audio signals, a system for displaying a virtual image to a user, and a system for producing sounds audible to a user. The handheld device also incorporates a shroud to block ambient light when the handheld unit is engaged with the user&#39;s face. As a result, the user may hear sounds produced from the received audio signals. Further the user may see the virtual images produced from the received video signals when the handheld device is engaged with the users face.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/591,518, filed Aug. 22, 2012, which is a continuation of 11/932,544,filed Oct. 31, 2007 and is now abandoned, which is a continuation ofU.S. patent application Ser. No. 09/837,128, filed Apr. 18, 2001 and isnow abandoned, which is a continuation-in-part of U.S. patentapplication Ser. No. 09/322,411, and filed May 28, 1999, now U.S. Pat.No. 6,578,203 issued Jun. 10, 2003; and which is a continuation-in-partof U.S. patent application Ser. No. 09/386,613, and filed Aug. 31, 1999,now U.S. Pat. No. 7,124,425 issued Oct. 17, 2006. The '128 Applicationalso claims priority to and the benefit of Provisional Application No.60/240,129, filed Oct. 13, 2000. The complete subject matter of all ofthe above applications are hereby expressly incorporated by reference intheir entirety.

BACKGROUND OF THE INVENTION

The present invention generally relates to an apparatus for processingvideo and/or audio signals and for displaying images and producingsounds based on the processed video and/or audio signals.

RELATED ART

Audio and video signals are generated from a plurality of sources duringmany events. An “event” is any occurrence viewed by a spectator. Forexample, at a football game or other type of sporting event, televisioncrews usually position cameras and microphones at various locations inthe stadium. As used herein, “stadium” shall be defined to mean anynon-movable structure having a large number (i.e., thousands) of seats,wherein an event occurs at (i.e., within a close proximity of) the seatssuch that spectators sitting in the seats can view and hear the event.These crews generate audio and video signals defining views and soundsof the football game from various perspectives.

One of the video signals and one of the audio signals are usuallyselected at a television station to form a combined audio/video signal.This signal is then modulated and transmitted so that users having atelevision can receive the signal via the television. The televisiondemodulates the combined signal and displays an image defined by thevideo signal on a display screen and reproduces the sounds defined bythe audio signal via speakers. Therefore, the sights and sounds of thegame can be viewed and heard via the television.

However, spectators viewing and/or hearing the sights and sounds of thegame via televisions are not usually given the opportunity to selectwhich video and/or audio signals are modulated and transmitted to thetelevision. Therefore, the spectator is only able to receive the signalsmodulated and transmitted to the television, even though the spectatormay prefer to receive the other signals that are generated at the game.

Spectators who actually attend the sporting event are usually given moreoptions to view and/or hear the sights and sounds of the sporting eventfrom different perspectives. In this regard, one or more monitors aresometimes located at one or more locations in the stadium. Each monitorwithin the stadium receives one of the aforementioned video signals anddisplays an image defined by the received video signal to many of thespectators. However, the monitor does not always display a desirableperspective with respect to each spectator in the stadium, and themonitor is often not located in a convenient location for many of thespectators. In this regard, many of the spectators often must leavetheir seats (or other locations) in the stadium and go to a locationwhere the spectators, along with other spectators, can view the monitordisplaying the desired perspective. The spectators viewing the monitoroften do not have control over which image is displayed by the monitor.

Thus a heretofore unaddressed need exists in the industry for providinga system and method that enables a spectator to conveniently view anevent from different perspectives.

SUMMARY OF THE INVENTION

The present invention overcomes the inadequacies and deficiencies of theprior art as discussed hereinbefore. Generally, the present inventionprovides a system and method for providing a user with a plurality ofaudio and video signals defining different sounds and views associatedwith an event.

The present invention includes a handheld device having a videoreceiver, a virtual image display device, and one or more speakers. Thevirtual image display device produces virtual visual images based onreceived video signals, and the speakers produce sounds based on thereceived audio signals. As a result, the user may hear the soundsproduced by the speakers and may see the video images produced by thedisplay device by holding the handheld device to the user's face, or theuser may watch the event live by removing the handheld device from theuser's face.

In accordance with, another feature of the present invention, thehandheld device incorporates an integrated light shield/shroud to blockambient light that can interfere with the user's ability to view thevirtual image. Unlike individual eye shrouds characteristic of a pair ofoptical binoculars, the present shroud shields both eyes at the sametime. Among other advantages, the present shroud enables the user tooperate the device while wearing eyeglasses or sunglasses.

Other features and advantages of the present invention will becomeapparent to one skilled in the art upon examination of the followingdetailed description, when read in conjunction with the accompanyingdrawings. It is intended that all such features and advantages beincluded herein within the scope of the present invention and protectedby the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention can be better understood with reference to the followingdrawings. The elements of the drawings are not necessarily to scalerelative to each other, emphasis instead being placed upon clearlyillustrating the principles of the invention. Furthermore, likereference numerals designate corresponding parts throughout the severalviews.

FIG. 1 is a block diagram illustrating a video/audio receiving system inaccordance with the present invention.

FIG. 2 is a block diagram illustrating more detailed view of a virtualimage display system depicted in FIG. 1.

FIG. 3 is a three dimensional side view of an exemplary handheld devicefor implementing the video/audio receiving system of FIG. 1.

FIG. 4 is a top view of the exemplary handheld device depicted in FIG.3.

FIG. 5 is a three dimensional front view of the exemplary handhelddevice depicted in FIG. 3.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

A preferred embodiment of the present invention will be describedhereafter in the context of football game applications. However, thescope of the present invention should not be so limited, and it shouldbe apparent to one skilled in the art that the principles of the presentinvention may be employed in the context of other applications,particularly in the context of other sporting events (e.g., auto races,basketball games, baseball games, hockey matches, etc.).

FIG. 1 depicts a video/audio receiving system 12 implementing theprinciples of the present invention. At least one video signal 14 and atleast one audio signal 15 are received by a receiver 16. Each of thevideo signals 14 defines a view of the event from a differentperspective. For example, the video signals 14 may be generated bydifferent video cameras located at different locations around thestadium. Furthermore, each of the audio signals 15 defines differentsounds associated with the game. For example, at least one of the audiosignals 15 may be generated from a microphone located close to thesideline of the game or in one of the helmets of one of the players ofthe game such that the audio signal defines sounds from the participantsin the game. Alternatively, at least one of the audio signals 15 maydefine the comments of television commentators, and at least one of theaudio signals 15 may define the comments of radio commentators.

In particular, at least one of the audio and one of the video signalsmay be transmitted as a single combined signal from an audio/videosystem described in U.S. patent application Ser. No. 09/322,411 entitled“Video/Audio System and Method Enabling a User to Select Different Viewsand Sounds Associated With an Event.” Additionally, one or more of thevideo and/or audio signals may be wireless, in which case, the interface18 may comprise an antenna for receiving the wireless signals. However,various other types of signal interfaces 18 are possible. For example,the signal interface 18 may be a cable or other type of signaltransmission apparatus. Any type of wireless and/or non-wirelesstechnique may be used to transmit signals to the video and audioreceiver 16 via the signal interface 18.

Some of the audio and video signals 15 and 14 can be unmodulated whentransmitted to the receiver 16 through the signal interface 18 and,therefore, do not need to be demodulated by the system 11. However, someof the audio signals 15 and/or video signals 14 may be modulated whenreceived by the receiver 16 and, therefore, may need to be demodulatedby the system 12. For example, at least one of the audio signals 15defining the comments of the radio commentators may be modulated as aradio signal for transmission to radios located at or away from thestadium, and at least one of the video signals 14 may be modulated as atelevision signal for transmission to televisions located at or awayfrom the stadium. Therefore, as shown by FIG. 1, the system 12preferably includes a demodulator 20 configured to demodulate anymodulated audio signals 15 and/or video signals 14 received by thereceiver 16 through the signal interface 18.

Once demodulated, if necessary, the audio and video signals 15 and 14are processed by signal processing logic 22, which selects andconditions the signals 15 and 14. More specifically, the signalprocessing logic 22 selects, based on inputs from the user, one of theaudio signals 15 and one of the video signals 14. Note that the logic 22may be implemented via hardware, software, or a combination thereof.Further, the logic 22 may include one or more filters for filtering outthe unselected signals 15 and 14. After selecting one of the audio andvideo signals 15 and 14, the logic 22 conditions the selected videosignals 15 so that they are compatible with the virtual image displaysystem 30, and the logic 22 conditions the selected audio signals 15 sothat they are compatible with the speakers 34. The logic 22 thentransmits the conditioned audio signals 15 to the speakers 34, whichconverts the conditioned audio signals 15 into sound. The logic 22 alsotransmits the conditioned video signals 14 to the virtual image displaysystem 30, which displays the image defined by the conditioned videosignals 14 according to techniques known in the art. Note that theprocessing performed by the signal processing logic 22 may be similar toor identical to the processing performed by the system in U.S. patentapplication Ser. No. 09/322,411 entitled “Video/Audio System and MethodEnabling a User to Select Different Views and Sounds Associated With anEvent.”

An input device 24, which may comprise one or more buttons knobs, dials,or other types of switches, may be used to provide the inputs for theprocessing performed by the processing logic 22. By controlling thecomponents of the input device 24, the user may control various aspectsof the processing performed by the logic 22, including which videosignals 14 are selected for viewing, as well as which audio signals 15are heard and the volume of the audio signals 15.

FIG. 2 depicts an exemplary virtual image display system 30 that may beemployed to implement the principles of the present invention. Aprocessed video signal 14 is displayed onto a Liquid Crystal Display 34.The Liquid Crystal Display 34 may be lit from the back via a back light36, with the light shining through the Liquid Crystal Display 34,creating an image on the other side of the Liquid Crystal Display 34. Onthe opposite side of the Liquid Crystal Display 34 from the back light36, some distance from the Liquid Crystal Display 34, is a half-silveredmirror 38. The halt-silvered mirror 38 is set at an approximatelyforty-five degree angle from the Liquid Crystal Display 34. The imagereflects off the half-silvered mirror 38 onto a separate curved mirror40 set some distance away from the half-silvered mirror 38. The curvedmirror 40 magnifies the virtual image. The magnified virtual imagereflects off of the curved mirror 40, back to the half-silvered mirror3S. The magnified virtual image passes through the half-silvered mirror38 to a lens 42 located on the opposite side of the half-silvered mirror38 from the curved mirror 40. The magnified virtual image passes throughthe has 42, which focuses the magnified virtual image. When the handhelddevice 50 is held to the user's face and the user 44 looks into the lens42, the magnified virtual image is observed by the user 44. The user 44observes the magnified virtual image as much greater in size than theactual size of the image on the Liquid Crystal Display 34, with saidmagnified virtual image appearing to the user 44 to be located severalfeet in front of the user 44. It should be noted that other embodimentsof the virtual image display system 30 may be employed without departingfrom the principles of the present invention. For example, in someembodiments, a single prism can be used to replace components 38, 110,and 112.

In the preferred embodiment, the receiver 16, signal processing logic22, virtual display system 30, and speakers 34 are all embodied within ahandheld device 50, which is discussed in further detail herein below.Note that the handheld device 50 may be comprised of a housing unit or acasing coupled to each of the components shown in FIG. 1. One or more ofthe components may be housed within the casing. By utilizing a handhelddevice 50 for viewing video signals 14, the user's experience may beenhanced. For example, when a handheld device 50 is used to show a fieldview of the game from a camera located on another side of the stadium,the user 44 sees a similar view as spectators located in that portion ofthe stadium. Because the handheld device 50 limits the user's peripheralview of the environment around Him the user 44 naturally focuses on theview provided by the handheld device 50. When the user 44 desires toview the game directly, the user may quickly lower the device 50 so thatthe user's view of the game is not obstructed by the device 50. Thehandheld device 50 may similarly enhance a user's experience at otherevents, such as other sporting events, for example.

Furthermore, since the device 50 is handheld, the device 50 is easilyportable, and the user 44 may carry the handheld device 50 with him andchoose where he would like to view the images produced by the handhelddevice 50. Indeed, the user 44 may roam the stadium with the device 50in hand while intermittently viewing the images and hearing the soundsproduced by the system 12. Furthermore, by manipulating buttons or othertypes of switches 56 in the user input 24, the user 44 may control whichvideo signals 14 are displayed and which audio signals 15 are producedby the system 12. Accordingly, the handheld device 50 gives the user 44more flexibility in how the user 44 observes and listens to the sportingevent and, as a result, makes the event a more enjoyable experience.

Many different types of casings for the handheld device 50 may beemployed to implement the present invention. FIGS. 3, 4 and 5 depict anexemplary handheld device 50.

As depicted in FIG. 3, the handheld device 50 includes a main component52, containing the system 12 (FIG. 1) used to provide a virtual image tothe user 44, as discussed hereinbefore. The handheld device 50 alsoincludes a shroud 54 to block out ambient light. The shroud 54 isadapted to receive the user's forehead and allows the handheld device 50to be engaged with the user's forehead while the user 44 is wearingeyeglasses or sunglasses. As can be seen in FIG. 5, the shroud 54 isshaped and sized to completely cover the user's eyes, allowing thehandheld device 50 to be held against the face and/or foreheadcomfortably and blocking ambient light. Also as a result, there is anamount of space between the eye position of the user 44 and the lenses42 which reside in front of the user's eyes sufficient to accommodatethe user's eyeglasses, e.g., about one inch or more (in one embodiment,about 25 mm).

As depicted in FIG. 4, one or more switches 56 can be placed on theoutside of the handheld device 50 for manipulation by the user 44 whenthe handheld device 50 is held to the user's face and/or forehead. Suchswitches 56 may include a rocker switch used to provide control of aparameter which varies through a range, such as channel selection. Otheritems that could be controlled in this fashion include, but are notlimited to, tint, hue or contrast of the image, image brightness, volumecontrol and the like. A slider switch (not shown) can be used, e.g., toselect among discrete choices. For example, the slider switch (notshown) may be used to select left, right or no relative frame phasing,to select between stereo and non-stereoscopic views, etc. Other controlsand/or indicators can also be used and can be mounted on varioussurfaces of the handheld device 50 of FIG. 4.

It should be noted that it is not necessary for the user 44 to keep thehandheld device 50 within the stadium. In this regard, the audio andvideo signals 15 and 14 may be transmitted via satellites and/orcommunication networks to various locations around the world, and theuser 44 may select the view he prefers the most from just about anylocation capable of receiving a video signal 14 and/or audio signal 15.

It should also be noted that the handheld device 50 may be retrievedfrom the user 44 after the user 44 is finished viewing the event so thatthe handheld device 50 can be provided to another spectator for anotherevent at the stadium. Each user 44 may be charged a usage fee for theuser's use of the handheld device 50. In some embodiments, payment ofthe fee may be required before the user 44 is provided with the device50. In other embodiments, the device 50 may receive information, viasignals 14 and/or 15 or otherwise, indicating whether the device 50 isauthorized to produce sounds and images defined by the signals 14 and15. In this embodiment, the device 50 is configured to produce suchimages and sounds only when authorized to do so, and such authorizationshould only be transmitted to the device 50 once the user 44 of thedevice 50 has provided payment.

It should be emphasized that the above-described embodiments of thepresent invention, particularly, any “preferred” embodiments, are merelypossible examples of implementations, merely set forth for a clearunderstanding of the principles of the invention. Many variations andmodifications may be made to the above-described embodiment(s) of theinvention without departing substantially from the spirit and principlesof the invention. All such modifications and variations are intended tobe included herein within the scope of the present invention andprotected by the claims.

What is claimed is:
 1. A method for providing a plurality of userselectable, different viewing perspectives associated with an event to auser of a portable handheld device while attending the event live, thehandheld device having a receiver, signal processing logic, a displayand a user interface, the method comprising: obtaining video signalsfrom a plurality of cameras located at an event, at least two of thecameras being located at different locations around the event andproducing video signals defining live video content of the event fromdifferent viewing perspectives; selecting, through the user interface ofthe handheld device, a first video signal from said video signals;wirelessly receiving the first video signal at the receiver of thehandheld device; displaying, on the display, the live video content fromthe first video signal selected at the user interface by the user;wherein the live video content, that is selected, corresponds to oneviewing perspective of the event associated with a single one of thecameras located at the event; and wherein the receiving and displayingoperations occur continuously a) only in response to selection by thefirst spectator of the first video signal for viewing while said liveevent occurs and b) until the first spectator chooses to select anotherlive video content from said video signals.
 2. The method of claim 1,further comprising demodulating the first video signal.
 3. The method ofclaim 1, further comprising: obtaining audio signals from a plurality ofaudio sources located at the event, at least two of the audio sourcesbeing located at different locations around the event and producingaudio signals defining live audio content of the event from differentperspectives; selecting, through the user interface of the handhelddevice, a first audio signal from said audio signals; wirelesslyreceiving the first audio signal at the receiver of the portablehandheld device; playing the first audio signal; and wherein the audioreceiving and playing operations occur continuously a) only in responseto selection by the first spectator of the first audio signal forviewing while said live event occurs and b) until the first spectatorchooses to select another live audio content from the audio signals. 4.The method of claim 1, wherein the displaying further comprises holdingthe handheld device to the user's face.
 5. The method of claim 1,wherein the displaying further comprises blocking ambient light when thehandheld device is held to the user's face.
 6. A portable wirelesshandheld device to be used at an event by a user while watching theevent live, the portable wireless handheld device comprising: a userinterface for selecting first video content from a first source out of aplurality of sources located at the event for viewing by a user on saiddisplay; a receiver configured to wirelessly receive the first videocontent transmitted wirelessly to said receiver, the first video contentbeing produced at the first source; signal processing logic configuredfor selectable operation by a user; a display configured to display thefirst video content only from the first source of said plurality ofsources; and wherein the receiver and display receive and display thefirst video content continuously a) only in response to the firstspectator's selection of the first video signal for viewing while saidlive event occurs and b) until the first spectator chooses to selectanother live video content from said video signals.
 7. The portablewireless handheld device of claim 6, further comprising logic to analyzeinformation received by said receiver indicating whether the device isauthorized to display a select image defined by said select videocontent.
 8. The portable wireless handheld device of claim 6, furthercomprising a handheld housing containing the receiver, signal processinglogic, and display.
 9. The portable wireless handheld device of claim 6,wherein said receiver wirelessly receives a plurality of audio signalsassociated with the event and further comprising a portable userinterface configured to allow said user to select at least one of saidaudio signals.
 10. The portable wireless handheld device of claim 6,wherein said receiver wirelessly receives a plurality of video signalsdefining said video content from said plurality of cameras at the eventthat the user is attending live and at another remote event.